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ABSTRACT 

The report evaluates attitudinal changes among the 44 
Appalachia Educational Laboratory's Employer-Based Career Education 
(AEL/EBCE) students during the 1972-73 academic year, as measured by 
the semantic differential, a test in vhich students were asked to 
select one of seven spaces separating bipolar adjectives for each of 
20 pairs of adjectives describing nine different concepts or 
abstractions. Students examined at the beginning of their involvement 
in the program (Group One beginning in September 1972 and Group Tvo 
beginning in January 1973) indicated a positive attitude to only one 
concept, education; all other concepts vere viewed as neutral. The 
data also indicated that the attitudes of Group One students remained 
fairly stable during the year* A comparative analysis of the Group 
One and Group Tvo students shoved that none of the group main effects 
vere statistically significant on any of the nine concepts, and that 
although some group by adjective interaction effects vere found, none 
vere meaningful in terms of the guestions for vhich answers vere 
sought. Of the report's three appendixes, one reproduces the semantic 
differential test instrument, and tvo provide statistical tables 
depicting analyses of variance for the test concepts. (Author/JR) 
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Preface 

The following report is one of a series resulting from the evaluation 
of the Employer-Based Career Education (EBCE) program as conducted by the 
Appalachia Educational Laboratozry, Inc., from September, 1972, through 
May, 1973 « The EBCE program has been designed as an educational alternative 
to conventional high schools through which students learn from planned 
experiences at employer sites as well as throu^ individuatlly guided academic 
exercises. 

The focus of this report is the cheuiges in attitude toward certain 
concepts by the students in the EBCE program. A semantic differential was 
designed and used as an atten^t to meatsure chamges in attitude during this 
first test year for the AEL/EBCE program. 

The data were analyzed and the report was written by Dr. James T. Ranson 
of the West Virginia College of Graduate Studies under contract to the 
Laboratory. Dr. James H. S2uiders was responsible for conducting and super- 
vising the evaluation, including the design of the instrument. Summative 
evaluation at the Laboratory is under the general direction of Dr. Charles L. 
Bertram, Director of Research and Evaluation. 
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Introduction 



The purpose of this report is to document the evaluation of 
attitudinal changes in subjects who participated in the Employer-Based 
Career Education (EBCE) program at Appalachia Educational Laboratory, 
Inc* during the 1972-73 academic year. This purpose is in response to 
the need for the EBCE program developers to have pertinent information 
on which to make decisions related to the EBCE program. 

The setting of the AEL/EBCE program is in the Charleston^ West Virginia, 
metropolitan area. Participants in the AEL/EBCE program were high school 
seniors from the Kanawha County school system. 

The 42 students were in two different groups of 21 each. One group 
(Group I) participated in the program during the entire 1972-73 academic 
year, emd the other group (Group II) participated during the second semester 
of the 1972-73 academic year. Group II originally contained 23 students, 
but 21 students were randomly selected for data analysis so that the two 
groups would .on tain an equal number of students. Of the 42 students for 
whom data were analyzed, 11 were girls and 31 were boys. 

The purpose of this evaluation was to monitor the attitudes of the 
subjects afe they progressed through the AEL/EBCE program. This purpose 
seemed particularly relevant since the assumption was made that any 
significant chemge in cognitive traits would also show up in affective areas 
as well. 

The Design 

As indicated earlier two groups of 21 pupils were the data sources 
for this evaluation. The two groups differed mostly by the length of time 



which they participated in the E3CE program. The sequence of EBCE treatment 



and testing periods is diagramed in Figure 1. 


Treatment 


Autumn 


Winter 


Spring 




Testing 


Testing 


Testing 




September 1972 


February 1973 


May 1973 




i 


4 


A 


Group I 
Group II 


0^ J EBCE 

^ No exposure 


1 O2 1 EBCE- 

—4 O4 {- — EBCE - 


— < O3 
1 O5 



Fi9ure 1 

Diagram of the Treatment and Testing Periods of the Students 

in the EBCE Program 



As indicated in Fig'ore 1, Group I was tested three times — September, 
1972, February, 1973, and May, 1973; and Group II was tested two times — 
February, 1973, and May, 1973. Given these conditions, the following 
questions provided direction to the investigation: 

1. What were the attitudes of the pupils toward identified 
school, community, and career education concepts at the 
beginning of the EBCE program? 

2. How did the attitudes held by the students at the beginning 
of the program compare with the attitudes held at midyear 
'»nd at the termination of the program? 

3. How did the attitudes of the group of pupdls who entered the 
program at midyear compare with the attitudes of the pupils 
who had been in the program since the beginning of the academic 
year? 
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The Measure 



The testing procedure used to measure the attitudes of the pupils 
was the semantic differential (SD) . The SD is a product of research 
under the direction of Charles £• Osgood^ on the measurement of meaning^ 
A set of bipolar adjectives divided by seven spaces is the response setting 
for the subject, and when the adjectives are so organized that the respondent 
associates the adjectives witli the concept, an attitude measurement can be 
obtained. Hie AEL/EBCE semantic differential was designed by Dr, James 
Sanders according to procedures described by Kerlinger,^ The instrument is 
attached as Appendix A. 

One purpose of the semantic differential is to measure some of the 
attitudes which respondents hold about abstract ideas on concepts. This 
purpose is accomplished by having the respondent to place a check mark in 
one of seven spaces which separate the bipolar adjectives. 

In this study, nine different: concepts or abstractions were used and 
the students checked each of the saune 20 bipolar adjectives for each concept* 
Most of the bipolar adjectives (15 of 20) have been validated by Osgood, 
but others were added in order to produce a more efficient measure of 
attitude. The use of this semantic differential during the 1972-73 academic 
year was the first use, and any findings are therefore considered provisional. 

The nine concepts were : 

(1) My chances for success in life are: 

(2) My future career plans are: 



-^-Charles Osgood, George J, Suri, and Percy H, Tannenbaum, itie 
Measurement of Mecuiing . (Urbana; University of Illinois Press, 1957, 1965), 

^Fred N, Kerlinger* Foundations of Behavioral Research , (New York: 
Holt, Rinehart and Winston, Inc., 1967), p, 564-580, 
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4 



(3) 


My responsibility to the governance of my coosnunity is: 


(4) 


Bducation is : 






(5) 


I am 






(6) 


The recreation facilities available to 


me in my community are: 


( ^ 


The social contributions of my conmxinity to my well being are: 


(8) 


All occupations are: 






(9) 


My contributions to my commxinity 


are : 




The 


20 bipolar adjectives were: 






(1) 


Wise - foolish 


(11) 


Important - unimportjuit 


(2) 


Valuable - worthless 


(12) 


Encouraging discouraging 


(3) 


Good - bad 


(13) 


Interesting - boring 


(4) 


Weak - strong 


(14) 


Clear - hazy 


(5) 


Consistent - inconsistent 


(15) 


Clean - dirty 


(6) 


Fair - unfair 


(16) 


Relcixed - tense 


(7) 


Progressive - traditional 


(17) 


Beautiful - ugly 


(8) 


Complete - incomplete 


(18) 


Sharp - dull 


(9) 


Meaningful - meaningless 


(19) 


Powerful - weeJc 


(10) 


Successful - unsuccessful 


(20) 


Colorful - colorless 



The respondent is asked to place a check mark on one of the seven spaces 
between each adjective. Each space is assigned a number, i.e., 1, 2, 3, 4, 
5, 6, 7, depending where it is located between the adjectives. The space 
located next to tne positive pole in the adjective pair is designated •'7" 
a»id the number next to the negative pole is **1*\ The unit of measure is 
therefore a "1" through "7" with "7" being the most positive and "1" being 
the most negative. 



The preponderance of the data that have been generated about the SD 
suggest three primary factors make up the meaning space of adjectives.^ 
These three factors, which were identified bj Osgood through a factor 
analysis procedure, were designated evaluative ^ potency f and activity. 
These same data also suggest that in general the evaluative factor is 
usually the strongest factor, euid eight of the 20 adjective pairs had been 
identified as evaluative in other studies. One preliminary assumption of 
this study is that the adjectives as a whole are evaluative in nature. 

Results 

Initial Student Attitude 

The first question was, "What was the general nature of the attitudes 
of the pupils at the beginning of the EBCE program?" To arrive at an answer 
to this question, cm assumption was made that "4** on the seven point scale 
indicated a neutral attitude toward a concept, and that variation from a "4" 
indicated a positive ojr negative attitude. Given this assus:ption, the error 
term of the F-ratio for testing the statistical significance of the differences 
for the three testing periods was used as an estimate of the variance of the 
meaning space in the population* Another assumption was that the mean semantic 
differential score for the Autumn testing was an estimate of the strength of 
meaning for the sample « Given these assumptions, a probability level of .05 
(two- tailed test) was used to define a region of rejection for the hypotheses 
that the observed means were equal to "4". The results of this analysis are 
presented in Table 1« The only concept of the nine which was determined to 
be other than neutral was Concept No. 4, "Education is". The mean for t^is 



Kerlinger, p. 567* 
Osgood, p. 36-38. 



concept was 5.52 which indicated a positive attitude toward education held 
by the pupils at the beginning of the program* 

Table 1 

Means, Variances, Regions of Rejection and Decisions Concerning 
the Meaningfulness of Nine Concepts for Group I 
Autumn Test Results 





Concept* 


X 


S2 


Region of 
Rejection** 


Meaningful 




1 


5.04 


10.12 


2.56>X>5.44 


No 




2 


5.31 


11.18 


2.49>X>5.51 


No 




3 


4.24 


. 8.93 


2.65>X>5.35 


No 


i 


4 


5.52 


10.86 


2.51>X>5.49 


Yes 




5 


4.86 


^.70 


2.59>X>5.41 


No 




6 


3.79 


13.78 


2.32>X>5.68 


No 




7 


4.10 


.15.42 


2.23>X>5.77 


No 




8 


4.86 


5.39 


-2.95>X>5.05 


No 




9 


4.34 


9.16 


2.63>X>5.37 


No 



♦Concept identification; (1) Chances for success, (2) career plans, 
(3) responsibility to governance of conuaunity, (4) education, (5) myself, 
(6) recreation facilities, (7) social contributions of my community, 
(8) occupations, and (9) my contribution to my community. 

**Two-tailed test p < .05. 



In ere preceding discussion the means were compared with an external 
value, namely, the value of "4" because the assumption was made that '•4" 
indicated a neutral attitude. For the ensuing discussion the comparison will 
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be based on internal criteria using the mean scores to determine whether any 
significant attitudinal differences existed among the nine concepts ♦ To make 
this comparison, the variances used in the error terms of the ratio to 
test differences across the three testing periods were pooled and used as 
the Vcuriance estimate for the "q"-statistiu. No statistically significant 
differences emerged as a result of this analysis ♦ Therefore, at the Autumn 
observation period the subjects held no differential attitudes with respect 
to the nine concepts. 

Change in Attitude 

The second question was, "How did the attitudes held by the students 
at the beginning of the progr2un compare with the attitudes held at midyear 
and at the termination of the program?" To arrive at an answer to this 
question a "treatment by treatment by subject" analysis of variance wais con- 
ducted on Group I aata* The first "treatment" was the three observation 
periods — Autumn, Winter, and Spring, and the second "treatment" was the set 
of 20 bipolar adjectives ♦ The ANOVA summary table is included as Appendix 
B. The semantic differential means for tile three observation periods, the 
F-test of the means for each of the nine concepts, and the probability 
associated with each F-test are given in Table 2. Figure 2 graphically 
depicts the means for the three testing periods and the nine concepts* 
Although all but one of the attitudes appeared to become more positive 
between Autumn and Spring testing, none of the F-tests were statistically 
significant using a criterion probability of •05, The positive change in 
Concept No. 9, "My contributions to my ccwnmunity are", was significant at the 
.10 level and would provide some evidence that the EBCE program participants 
began to regard their role in their community more positively. In general, 
the attitudes of Group I students remained fairly stable during the year. 



Table 2 
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Means of the Concepts of Group I across the "rtiree Observation 
Periods, F-Ratios, and Levels of Significance 


Concept * 


Fall 


Winter 


Spring 


P 


P 


1 


5.04 


5.27 


5". 36 


1.17 


NS 


2 


5.31 


5.22 


5.45 


0.47 


NS 


3 


4.24 


4.46 


A a A 




NS 


4 


5.52 


5.05 


5.16 


2.31 


NS 


5 


4.86 


4.75 


5.04 


0.92 


NS 


6 


3.79 


3.70 


4.12 


1.50 


NS 


7 


4.10 


4.04 


4.44 


1.28 


NS 


8 


4.86 


4.80 


5.12 


2.29 


NS 


9 


4.34 


4.49 


4.80 


2.44 


0.10 



♦Concept identification: (1) Ch2mces for success, (2) caireer pl£uis, 
(3) responsibility to 9ovem2mce of conmunity, (4) education, (5) n^self , 
(6) recreation facilities, (7) social contributions of coxnmunity, 
(8) occupations, auid (9) my contribution to my community. 



CQggarison of Group I and Group II Attitudes 

The third question was, "How did the attitudes of Group II students 
who entered the progreua at midyear compare with those of Group I students 
•who participated in the program for the entire academic year?** To arrive at 
an answer to this question a mixed model analysis of variance design was used. 
%is ANOVA design controlled for group differences. Winter and Spring testing 
periods, and the 20 adjective pau.rs. The group main effects amd the group 
by testing period interaction were of interest in comparing the two groups 
across the two testing periods. 



The gxo\xg main effect was a test on the pooled Winter and Spring means 
for Group I and Group II. None of the group main effects were statistically 
significant on any of the nine concepts. The pooled Winter and Spring means 
the F-ratios^ and the probability levels for each of the nine concepts are 
presented in Table 3. 



Table 3 





Pooled Winter and Spring Means for Group I and Group II, 
and Probability Levels for Difference between Groups 


F-Ratios 


Concept* Groiip I 


Grovp 11 


F-Ratio 


P 


1 


5.32 


5,34 


0.01 


NS 


2 


5.33 


5,39 


0,06 


NS 


3 


4,55 


4,70 


0,19 


NS 


4 


5,11 


5,39 


1.03 


NS 


5 


4,90 


5,19 


1,13 


NS 


6 


3.92 


4,13 


0,32 


NS 


7 


4.24 


4,48 


0,51 


NS 


8 


4.96 


4,79 


0,47 


NS 


9 


4.64 


4,61 


0,02 


NS 



♦Concept identification: (1) Chances for success, (2) career plans, 
(3) responsibility to governance of comnunity, (4) education, (5) myself, 
(6) recreation facilities, (7) social contributions of iry community, 
(8) occupations, and (9) my contribution to my community. 



After evaluating the group main effect, the group by testing period 
interaction for each of the nine concepts was evaluated. The meems for 
Group I and Groiop II at the Winter cuid Spring testing periods, the group 
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by testing period interaction, F-ratio, and the probability levels are 
given in Table 4. None of the interaction effects with the exception of 
Concept No. 9 were statistically significant. 

Concept No. 9 was specifically "My contributions to my coouavmity were". 
Hiis concept had a statistically significant interaction (p < .03) \rtiich 
was apparently due to a reversal in attitude at the Spring testing. At the 
Winter testing Group II had a more positive attitude than did Group I, and 
at the Spring testing. Group I had a more positive attitude than did Group II. 

The differences between the means for Group I and Group II at^ the Winter 
and Spring testing periods is also presented in Table 4. With the assximption 
that the error value for the group by period interaction was a variance 
estimate of differences between the two meauis, the critical region for the 
differences between the means was calculated and yielded no differences which 
were statistically significant at the .05 level (two-tailed test) . Based 
on the statistical analyses, no significant differences were found between 
Group I and Group II in relation to the two testing periods. 

Other statistically significant findings did emerge in the analysis. 
One such finding concerned group by adjective interactions on concepts 1, 2, 
4, 7, and 8. In concept 1 ("My chances for success") the two groups rated 
the good-bad" and the "strong-weak" differently with Group I expressing a 
stronger negative reading than Group II on these two bipolar adjective pairs. 
This finding could be quite significant becaiJise these two adjective pairs 
measure strength of meaning about a concept. 

Hie adjectives main effect was statistically significant in the analyses 
for each of the nine concepts. The adjectives were selected to assess the 
attitudes of the paurticipants in the program. Probably the most useful method 
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for analyzing and interpreting the adjectives would be to conduct a factor 
analytic study to isolate common variance among the adjectives; however, this 
type of analysis is beyond the scope of this study. 

Summary and Implications 

Assuming that the middle space in the seven space scale of the bipolar 
adjectives is indicative of meaninglessness, i.e., a neutral position, the 
only concept which was meaningful at the beginning of the year was "Education 
is". Subsequent analysis indicated that no change occurred across the three 
testing periods except for the students' attitude toward their community 
which became progressively and significantly more positive with succeeding 
testing periods. No differences between Group I and Group II were detected. 
Some group by adjective interaction effects were found, but were not meaningful 
in terms of the questions for which euiswers were sought. 

The purpose of this study was to monitor the attitudes of the participants 
in the AEL/EBCE program during the 1972-73 academic year. The attitudes 
do not appear to have been affected either for good or bad. In fact, the 
attitudes remained constant in Group I during the year, and Group II which 
entered at midyear was equal to Group I for the period of time which they 
were in the program. 

Education appears to be the roost meaningful of the nine concepts which 
were used. The positive attitude recorded at the first of the year remained 
high throughout the program. This could indicate that the pupils enter 
school with a high degree of motivation and expectation. However, these 
conclusions warrant more investigation before they can be taken very seriously. 




Appendix A 
Semantic Differential 
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IS 



Name Age Sex 

DIRECTIONS 

!• This survey is to lei- you describe how you feel or what you think. 

2. Sh<M what you think about the concept (phrase) on the top of each 
page by placing an "X" in one of the seven blanks between each set 
of adjectives (from very good to very bad), 

3. Use only one mark for each pair of adjectives, but each pair should 
have one mark. 

4. There are no ri^t or wrong answers. Your first thought is usually 
the best one to record. 

Exanqple: 

Please react to the concept: 

ICE CREAM 

Good Bad 



You might have reacted to the concept ICE CREAM in one of seven ways. 
The following illustrates the seven different ways you might have marked 
with an interpretation of each alternative. 



Good 

Very Good 
Moderately Good 
Somewhat Good 
So-So or 

Maybe no Meaning 



Bad 



Somewhat Bad 
Moderately Bad 
Very Bad 



ERIC 
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MY CHANCES FOR SUCCESS IN LIFE ARE: 



wise 
valuable 
good 
weak 

consistent 
fair 

progressive 

complete 

meemingful 

successful 

unin^rtant 

discouraging 

interesting 

hazy 

dirty 

relaxed 

ugly 

sharp 

weak 

colorful 



foolish 

worthless 

bad 

strong 

inconsistent 

unfair 

traditional 

incon^lete 

meaningless 

unsuccessful 

important 

encouraging 

boring 

clear 

clean 

tense 

beauti f ul 

dull 

powerful 
colorless 



MY FUTURE CAREER PLANS AREj 



wise 
valuable 
good 
weak 

consistent 
fair 

progressive 

complete 

meaningful 

successful 

unimportant 

discouraging 

interesting 

hazy 

dirty 

relaxed 

ugly 

sharp 

weak 

colorful 



foolish 
worthless 
bad 
strong 

inconsistent 

unfair 

traditional 

ihcoitplete 

meaningless 

unsuccessful 

important 

encouraging 

boring 

clear 

clean 

tfense 

beautiful 

dull 

powerful 
colorless 
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MY RESPONSIBILITy TO THE GOVERNANCE OF MY OOFWUNITY ISj 



wise 
valuable 
good 
weak 

consistent 
fair 

progressive 

complete 

meaningful 

successful 

unimportant 

discouraging 

interesting 

hazy 

dirty 

relaxed 

ugly 

sharp 

weak 

colorful 





foolish 
Worthless 
bad 
strong 

inconsistent 

unfair 

traditional 

incoofilete 

meaningless 

unsuccessful 

iiqportant 

encouraging 

boring 

clear 

clean 

tense 

beautiful 

dull 

powerful 
colorless 



EDUCATION IS: 



wise 
valuable 
good 
weak 

consistent 
fair 

progressive 

complete 

meaningful 

successful 

unimportant 

discouraging 

interesting 

h . V/ 

dxrty 

relaxed 

ugly 

sharp 

weak 

colorful 




foolish 
worthless 
bad 
strong 

inconsistent 

tinfair 

traditional 

incomplete 

meaningless 

unsuccessful 

import am t 

encouraging 

boring 

clear 

clean 

tense 

beautiful 
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I AH: 
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THE RECREATION FACILITIES AVAILABLE TO ME IN MY COMMUNITY ARE: 
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THE SOCIAL CONTRIBUTIONS OF NY COMMUNITY TO MY WELL BEING ARE: 
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ALL OCCUPATIONS ARE: 
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MY QONTRIfiUTIONS TO MY COMMUNITY ARE: 
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Appendix B 

F-Ratios and Levels of Significance for Group I Analysis 
of Variance by Their Testing Periods and Twenty Adjectives 
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P**Ratios and Levels of Significance for Groiqp I Analysis of 
Variance by Bieir Testing Periods and Twenty Adjectives 



Concepts* Period Adjective Period x Adjective 



Concept 


1 




5.48, 


p<.000i 




Concept 


2 




8.09, 


p<.0001 




Concept 


3 


- 


2.49, 


p<.001 




Concept 


4 




14.08, 


p<.0001 


1.52, p<.05 


Ccaicept 


5 




3.68, 


p<.0001 


2.17, p<.001 


Concept 


6 




1.75, 


p<-05 




Concept 


7 




3.16, 


p<.0001 




Concept 


8 




9.07, 


p<.CC01 




Concept 


9 


2.44, p<.10 


2.62, 


p<.001 





*Concept identification: (1) Chances for success, (2) career plans, (3) responsibility 
to govememce of cozmnunity, (4) education, (5) nyself, (6) recreation facilities, 
(7) social contributions of my comniinity, (8) occupations, and (9) my contribution 
to my commxinity. 
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Appendix C 



FH^tios and Levels of Significance for Main Effects and 
Interactions of Two Groups Over Two Testing Periods 
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